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ABSTRACT 

A study of reader response to newspaper articles in a 
defamatory context tested; (1) the judicial assumption that the 
macro-environment in which statements appear is important to a 
reader's distinguishing between fact and opinion; (2) the possibility 
that a byline may influence a reader's characterization of 
statements; and (3) the idea that people react differently to opinion 
than to fact. Since American libel law protects statements of opinion 
and finds only fact statements defamatory, an understanding of how 
readers distinguish between opinion and fact is crucial to attorneys, 
judges, journalists and publishers. Subjects, 57 Stanford University 
(California) students, read a mock newspaper in which two articles 
appeared on a news page and two were on an editorial page, and were 
asked to rate the articles as to their opinion or fact nature and to 
assess the person being defamed by the articles. Findings indicated 
that the macro-context strongly influences reader perception, so that 
an article appearing on the editorial page is more likely to he 
considered opinion than when that same article appears on the news 
page. The presence or absence of a byline was not found to influence 
the fact/opinion distinction. Surprisingly, statements perceived to 
be opinions were more influential in assessing the defamed person's 
reputation than statements perceived as facts. (Four pages of 
endnotes and three tables of data are attached.) (MHC) 
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Courts must decide under the rules of American libel law 
whether a defamatory statement is a statement of opinion or of 
fact. Implicit in the law are assumptions about the manner in 
which readers distinguish between fact and opinion, a fact that 
suggests value in exploring the criteria people use to make such 
distinctions. 

American law applicable to the mass media actually 
distinguishes among three types of defamatory statements. 
Statements of fact that are true receive nearly absolute 
protection. 1 Statements of fact that are false subject the 
author to liability, although numerous defenses based on the 
author's conduct and the content of the message are available 
that may mitigate or eviscerate such liability. Statements of 
opinion, no matter how vitriolic in nature, are protected from 
libel suits. 3 

Opinion 

After nearly two centuries of varying levels of state by 
state common law protection, the Supreme Court found a First 
Amendment recognition of the fact/opinion distinction in 1974 
when Justice Powell held in Gertz v. Welch that, 

Under the First Amendment, there is no such thing as a 
false idea. However pernicious an opinion may seem, we depend 
for its correction not on the conscience of judges and juries 
but on the competition of other ideas. But there is no 



constitutional value in false statements of fact. 4 
Since £extS/ the arena of safe opinion has encompassed all 
topics, not just the political speech protected in most common 
law. The legal theory underlying the Gertz dicta on opinion is 
that only statements that can be proved or disproved may be 
considered defamatory and therefore subject to redress for harm 
to reputation. 

A recurring problem has been the difficulty of developing a 
suitable legal distinction that can be applied consistently. I: 
the end, statements accepted by one reader as opinion may be 
interpreted by another as fact. A suit against columnist Ellen 
Goodman provides a useful example. In 1983, Goodman wrote a 
column highly critical of the outcome of a rape trial that found 
the defendants not guilty on the rape charge, yet guilty of a 
charge of malicious damage to an automobile involved in the 
incident. Goodman wrote, 

What is agreed upon by everyone is that the men took 
turns. While one was jumping on her, the others were 
jumping on the car. At the end, the bruised auto was 
rolled over the embankment. The bruised woman was left 
naked in the January night.... on June 17, they were 
found innocent of damaging the woman but — hosanna and 
pass the scales of justice guilty of damaging the car. 5 

In the ensuing libel suit against Goodman, the plaintiffs 
argued that the statement, "while one was jumping on her, the 
others were jumping on the car," was a false statement of fact. 
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The judge found the column to be opinion containing no statement 
of fact. The judge based his decision on the reasoning that 
Goodman , 

uses the rhetorical device of personification to make 
an automobile a person and by adroit cadence of 
parallel sentences compares the favorable treatment of 
a motor vehicle to the shabby treatment of women in 
rape cases. 6 

It is easy to see how some might have seen Goodman's 
comments as verifiable statements of fact — especially readers not 
adroit enough to recognize parallel constructions used as 
literary device. Decisions such as this one call into question 
the tenet that law must be applied consistently and subject the 
judge to the charge that his decision was based on visceral (if 
literary) reaction, rather than predictable legal rules. 

Further complicating the issue, the Supreme Court did not 
provide in Gertz a systematic means for either federal or state 
courts to distinguish between fact and opinion statements. The 
problem was left to future cases and at this writing, the High 
Court has accepted no appeal for hearing that would provide a 
conclusive answer at the national level. Nonetheless, a federal 
Court of Appeals developed a four part test in 1984 that has 
received wide attention. The case considered a libel suit 
against nationally syndicated columnists Evans and Novak by a 
political science professor who had been the subject of their column. 
Evans and Novak questioned the professor's leftist views in their 
column and argued in court that the column was opinion and therefore 
intitled to First Amendment protection. 



Writing for a plurality in oilman v. Evans . Judge Starr set 
four criteria to distinguish fact from opinion. 

1. What is the common usage or meaning of the allegedly 
defamatory statements? 7 

2. To what degree are the statements at issue verifiable as 
statements of fact? 8 

3. What is the micro-context of the statements ~ that is, 
what is the tone of the rest of the article or story? 9 

4. What is the macro-context — that is, do the statements 
appear on a news or editorial page or in a forum regularly 
recognizee as one encouraging opinion? 10 

Of special relevance to this study is criterion 4, the macro- 
context of the statement. Starr found it very important that the 
statements in question appeared in a column and that the column 
appeared on the op/ed page, "the well-recognized home of opinion 
and comment." 11 Page environment r then, is assumed to be a 
primary indicator for readers of whether a statement is fact or 
opinion. 

In a dissenting opinion, however, Judge Wald was less 
impressed than Starr by the macro-context in which the statements 
occurred, writing that "the immediate context in which the 
statement was made does little to warn a reader to regard with 
skepticism what might otherwise appear to be an assertion of 
fact." As legal commentator Timothy Gleason has pointed out, 

"Judge Starr's characterization of the context as one in which 
readers will expect opinion statements is no less credible than 
Judge Wald's assertion that the context supports a finding of 



fact." ±J 

Another aspect of macro-context that could assume relevance 
in fact/opinion deliberations is whether the article has a by- 
line. Although this potential indication has never been 
addressed by the courts, a 1985 study commissioned by the 
American Society of Newspaper Editors (ASNE) found evidence that 
readers tend to equate a by-line with opinion. 14 The 
correlation, explored in more deail below, justifies an initial 
examination of the possibility under experimental conditions. 

In the process, then, of protecting opinion from libel suits, 
the courts imbed two implicit assumptions. 15 First, the courts 
assume that individuals, whether readers of a newspaper, viewers 
of television, or other consumers of information, distinguish 
between fact and opinion in the messages they receive through the 
mass media. Second, the courts must assume that judicial 
formulas accurately distinguish between fact and opinion. 

With libel suits regularly involving seven figure damage 
claims, 16 these two assumptions become important to 
journalists, publishers, attorneys, judges and the subjects of 
journalistic scrutiny who sometimes turn to the courts to 
vindicate possibly tarnished reputations. 17 A first step 
toward testing these assumptions is to empirically determine 
whether and how people perceive differences between defamatory 
opinion and factual statements and the effects of these 
perceptions. Empirical attempts to date, however, have been 
limited in scope and none are applicable directly to specific 

18 

fact/opinion formulas developed by the courts. ° 

This paper presents experimental tests of some assumptions 
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about the ways in which readers distinguish fact from opinion in 
defamatory context, and about differences in impact on readers 
based upon their perceptions of whether a report is fact or 
opinion. 

We first discuss and test two aspects of the macro-context 
of an article that might effect a reader's perceptions of 
fact/ opinion: page environment and by-line. 

We then empirically examine the differential effect of 
perception of fact versus opinion on reader assessment of the 
defamed person. The constitutional distinction between fact and 
opinion is based not on the question of whether fact is capable 
of causing more damage to reputation than opinion, but simply on 
the Gertz rationale that a fact can be proven true or false while 
an opinion can be neither right nor wrong. 19 Nonetheless, the 
fact/opinion distinction seems to carry at least an implicit 
assumption that people recognize differences between fact and 
opinion and weigh those differences accordingly. 

Page Environment 

Courts have developed numerous approaches to making 
distinctions between defamatory statements that are opinion and 
those that are presented as fact. Page environment is used as a 
criterion in many of these judicial fact/opinion tests. Page 
environment refers to the characteristics of the page on which a 
newspaper article appears, is the material on a news page 
normally associated with factual stories, or on a page set aside 
for editorials, letters to the editor, and opinion columns? 

A basic approach that relies on page environment as a 
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threshold element appeared in Oilman v. Evans in 1984, a case 
that appears to be indicative of current judicial thinking. 20 
Each of the four federal Courts of Appeal fact/opinion libel 
cases decided since then have incorporated the Oilman guidelines, 
a strong indicator of an emerging coalescence of approach. x 

In focusing on the issue of whether the defamatory statements 
in question appeared on a news page or on an opinion/editorial 
page of a newspaper, the judicial assumption is (1) that readers 
are aware they are reading statements placed either on a news 
page or on an op/ed page; (2) that readers are aware of the 
difference in function and content of news and op/ ad pages; and 
(3) that these recognitions play a significant role in reader 
perception of whether defamatory statements are fact or opinion. 

Contradictory Findings 

There are reasons to doubt these assumptions. One-fourth of 
those polled in the ASNE survey believed that "columnists are not 
entitled to include opinions in their columns." 22 About half 
those polled believed the editorial pages contained 3bout the 

23 

same amount of opinion as the rest of the newspaper. ^ About 

one fourth believed the front page actually contains more opinion 

than the rest of the newspaper. 24 

The study also found that forty percent of readers believe 
"most media don't do a very good job of separating fact from 
opinion. " 25 

A similar study, commissioned by the Associated Press 
Managing Editors Association, found that one in four readers 
believe newspapers "mix fact and opinion." 26 



It is easy to conclude from these findings that the 
appearance of statements on an op/ed page or a news page is not a 
reliable indicator of reader perception. At the least they 
suggest continued attention to the ways in which people 
distinguish between fact and opinion. 

By-line 

Although the courts have not considered by-line as a 
reliable fact/opinion indicator, four of ten readers polled by 
ASNE believed "When a reporter's by-line is put on a story, the 
reporter is entitled to put his or her opinions in the story." 27 
Implicit in the finding that a significant minority or readers 
appear to misunderstand the meaning or purpose of a by-line is 
the possibility that readers who equate by-line with the presence 
of opinion would incorrectly identify by-lined stories, no matter 
where they appeared, as more opinionated than comparable stories 
that did not have a by-line. 

Methods 

Fifty-seven Stanford students read a mock two-page newspaper 
comprising a front page and an editorial page. Each page had two 
articles, one with a by-line and one without a by-line. Thus, 
environment, by-line, and their interaction constituted the 
manipulations in the experiment. 

To control for individual differences, we created four forms 
of the mock newspaper. Each form of the newspaper contained the 
same four articles, with each article chosen to be a) critical of 
a single (pseudonymous) individual and L>) at issue in a libel 
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case decided on the basis of the fact/opinion distinction. 28 The 
design of the study is a two-by-two Latin square, with each 
article appearing with a different combination of environment and 
by-line for each form. 

The first dependent variable of interest is the extent to 
which the subjects perceived each article to be fact or opinion. 
Subjects were asked to underline the phrases in each article that 
they felt were statements of opinion rather than statements of 
fact, whether true or false. We then totaled the number of 
underlined phrases for each article. Later in the experiment, 
subjects were asked to rate the fact/ opinion nature of each 
article as a whole on a 19-point continuous scale ranging from 
"Mostly Fact" to "Mostly Opinion." 

Opinion change is the second issue addressed in our study. 
We wanted to know which carried greater potential for damage to 
reputation, messgaes perceived as defamatory facts or those 
perceived by readers as opinion? 

For each of the four persons named in the articles, students 
were asked to respond to the question, "How would you rate your 
impression of Anthony Collins [i.e., the defamed person]? Would 
you say that your impression of him is:". The question utilized 
a 19-point continuous scale ranging from "Positive" to 
"Negative." The use of fictitious names in the articles ensured 
that the subjects did not have strong pre-existing attitudes 
toward the people to be evaluated. 

Results 

The two measures of fact/opinion — the total number of 
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underlined phrases and the subject's overall evaluation — showed 
low magnitude of correlation (r=?.29; p<.001), so separate 
analyses were run for each of ths two measures of the dependent 
variable. 

The first step in analyzing the Latin Square design was to 
control for individual differences and to check for possible 
confounding effects o*. the four versions of the mock newspaper. 
As expected, there were significant individual differences for 
both total number of opinion phrases in each article (p < .001) 
and overall evaluations of ths articles (p < .01). Fortunately, 
there was no significant effect for the version of the newspaper 
for either measure (p >.l and p >.6, respectively), indicating 
that the articles could be viewed as replications of one another 
as intended in the original design. 



***** Table 1 About Here **** 

Table l presents the analysis of variance table for the 
relationship between page environment and by-line and the total 
number of underlined phrases. There is a highly significant 
difference (F(l, 53)=14 . 0; p < .001) ) 29 , with articles on the front 
page seen as having fewer opinion statements than articles on the 
opinion page (Mean=14.2 vs. 16.4). There is no effect, however, 
for by-line (F(l,53) = .16; p > .5), nor is there a significant 
interaction effect (F(l,53) = .03; p > .5). 

The results for overall evaluation of the article show a 
similar p-- • . Articles on the front page are seen as 
contain. cantly less opinion than articles on the 
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opinion page (Mean = 9.9 vs. 10.7; F(l,53)=5.5; p < .05). Again, 
there is no effect for by-line (F(l,53)=.08; p > .5) and the 
interaction term is not significant (F(l,53)=.00; p > .3). The 
environment of an article does tend to influence readers 1 
perception of how opinionated the article is. By-line, however, 
does not seem to have an effect on the reader's perception of 
opinion. 

***** Table 2 About Here **** 

Turning to the second assumption implicit in fact/opinion 
issues in libel, we examine the relationship between the 
perception of the extent of opinion in a defamatory article and 
the reader's ev ".uation of the defamed person to see if perceived 
factual assertions are truly more damaging than perceived 
statements of opinion. We also test for any effect on damage to 
reputation for page environment and by-line, independent of their 
effects on the reader's evaluation of fact/ opinion. 

To test these relationships, evaluation of the article's 
referent is the dependent variable in an analysis of covariance 
model with either total number of opinion statements or overall 
assessment of how much opinion the article contained as a 
covariate and either page environment or by-line as the 
independent variable. 30 The results are presented in Table 3. 

**** Table 3 About Here **** 

When the total number of opinion statements is used as the 
measure of how much opinion exists in an article, opinion is 
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significantly related to the perception of the referent, in 
models that include either page environment (F (1,53) =16; p<.001) 
or by-line (F(l,53)=17; p<.001). Surprisingly, the direction of 
the relationship is negative; that is, readers who see an article 
as mostly opinion think less of the referent than readers who see 
the article as mostly fact (r=.23; p<.001). Neither environment 
(F(l,53)=2.1; p>.4) nor by-line (F(l,53)=l.l; p > .5) nor the 
interaction of environment or by-line with number of opinion 
phrases is significant. 

The results using overall evaluation of an article's 
fact/opinionness as the covariate show similar though weaker 
results, opinion is significantly related to 
perception of the referent in models with either environment 
(F(l,53)=4.1; p<.05) or by-line (F(l,53)=3.8; p<.08). Consistent 
with the earlier surprising finding, opinion articles are more 
influential (lead to lower evaluations of the referent) than are 
articles perceived as fact (r=.14; p<.001). Again, environment 
and by-line are clearly not significant when controlling for 
opinionness of the article (all p > .2). 

Discussion 

The rationale for protecting opinion is thoroughly integrated 
into the American legal fabric, one year after the ratification 
of the First Amendment, Thomas Jefferson wrote to George 
Washington, "If there be any among us who would wish to dissolve 
this union or to change its republican form, let them stand 
undisturbed as monuments of the safety with which error of 
opinion may be tolerated, where reason is left free to combat 
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it." 31 The plethora of opinion — wrongheaded, controversial, 
seditious, or otherwise — that makes up the free marketplace of 
ideas 32 has long been recognized as a linchpin of democratic 
xdeals. 

Libel law attempts to incorporate the ideals of the open 
marketplace of ideas theory Jefferson so eloquently penned to 
Washington. Justice William Brennan's Opinion for the Court in 
New York Times v. Sullivan placed constitutional force behind 
the notion that even false defamatory statements of fact must be 
tolerated when they are directed at the public actions of public 
officials and they occur without actual malice. ^ The 
marketplace, Brennan reasoned, requires "breathing space 11 if it 
is to flourish. 34 Justice William Powell's opinion in Gertz 
v. Welch expanded the First Amendment foundation protecting 
criticism and required all courts to distinguish between 
statements of fact and statements of opinion. 

This research focused not on the legal theory underlying the 
fact/opinion distinction in libel, but on assumptions about the 
manner in which people read newspapers — assumptions that can be 
found within the judicial process. We examined the judicial assumption 
in Oilman v. Evans that the macro-environment in which statements 
appear is an important reader cue. We examined the related 
possibility that by-line is an important indicator. We also 
examined the idea that people react differently to opinion 
statements than to factual statements in terms of reputation. 

Our experimental findings strongly suggest that the macro- 
context does indeed matter. Placing the same article on the 
op/ed page and on the front page, readers were far more likely 
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to perceive the article as opinion when it appeared on the op/ed 
page. Judge Starr's fourth criteria in Oilman finds support her<_ 
as a means to distinguish between perceived statements of 
fact and opinion. 

Each of the courts 1 assumptions abou page environment that 
we stated earlier appears borne out by the research. In drawing 
fact/ opinion distinctions readers appear to be aware at some 
level that they are reading statements placed either on a news 
page or on an op/ed page, and that there is a difference in 
function and content based on placement. Furthermore, *cnese 
recognitions play a significant role in influencing reader 
perceptions of whether statements are fact or opinion. 

Additional questions about the macro-context are ripe for 
inquiry. Do readers relate differently to columns, editorials, 
and letters to the editor — the standard fare of the op/ed 
pages? Does labeling such as "news analysis" make a difference 
in reader perception? Do people react differently to recognized 
by-lines (columnist Ellen Goodman's, for example) Also unanswered 
is whether the appioach studied here is media-specific. Does the 
macro-context approach work equally well when applied to 
television, radio, or other media? 

Our readers did not appear to consider by-line in their 
determination of whether statements were fact or opinion. These 
results seemingly contradict the expectations suggested by 
earlier survey research. it is likely thct our experimental 
subjects did not attend to the presence or absence of by-lines as 
cues, while the survey respondents were asked directly about the 
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significance of by-lines as cues, artificially bringing the 
matter to their attention* Nonetheless, this is a useful finding 
in the sense that it is suggestive that some macro-context cues 
are far more important than others . It also suggests that courts 
might benefit from future communication research that identifies 
significant reader cues within the fact/ opinion context* While 
the question of whether a statement is fact or opinion is a 
question of law within a libel suit, it is also a question of 
communication effects. 

Material for a different debate emerges when we focus on the 
question of whether subjects were more influenced by statements 
of fact or statements of opinion. In our study, articles 
perceived as opinion appeared to influence readers more than 
articles perceived as factual. This is actually in line with 
earlier research that found a tendency to see negative 
information as biased and opinionated, regardless of its factual 
basis. 3 More negative articles, then, would be expected to 
produce greater opinion change, and would also be seen as more 
opinionated. 

Does the possibility that people are more influenced 
by opinion than by fact suggest that Jefferson was 
too optimistic in assuming that "error of opinion may be 
tolerated, where reason is left free to combat it." In our 
experiment, opinion was given more weight than statements of 
fact in reader's evaluations. But while our findings suggest 
that opinion has the potential to cause equal or greater harm to 
reputation than does the publication of defamatory facts, our 
experimental environment in no way replicated the multitude of 
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voices normally available to citizens. 

Legal commentator Robert Sack has noted that under 
constitutional law there can be no such thing as a false idea or 
opinion. As Sack wrote, "A defamation is actionable only if it 
is false; opinions cannot be false; therefore opinions can never 
be actionable even if defamatory" 36 It may be, as the court 
implies in Gertz f that opinions cannot be proven true or false. 
Yet our research also suggests that opinions may be quite* capable 
of carrying a defamatory reputational sting at least as damaging 
as any factual statement. 

The conclusion to be reached is not that opinion statements 
should, like false defamatory statements, be subject to 
liability. Our research did not provide subjects with the 
alternative sources of information available in a true 
marketplace necessary to achieve the "reason" on which Jefferson 
relied. Empirical research into communication and law is at its best 
when it adds to the freedom of expression debate. Our research 
supports the judicial use of macro-context in distinguishing fact 
from opinion and suggests there is value in further research 
aimed at a more complete identification of the relevant reader 
cues. It also suggests potential for a debate on the function of 
libel that would take into consideration the potential harm to 
reputation eminating trom unkind opinion. 
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Table 3.. Analysis of Variance Testing Effects of Page 

Environment and By-line on Total Number of Perceived 
Opinion Statements in Each Article. 



Source of Variation 

Page Environment 
By-line 

Page Environment x By-line 

Page Environment, x 
Subject within form 

By-line x 

Subject within form 

Page Environment x By-line x 
Subject within form 

Constant 

Form of Newspaper 
Subject within form 



DF Mean Square 

1 267.6*** 

1 3.2 

1 .4 

53 19.1 

53 19.6 

53 11.6 

1 53574.7 

3 76.8 

53 72.6 



** 
*** 



p < .05 
p < . 01 
p < . 001 



Note: In determining the significance of the nain effects and the 
interaction in a Latin-square design, one calculates the F- 
statistic by dividing the mean square associated with the effect 
by the mean square associated with the effect -by-sub ject-within- 
form. Thus, the F for environment is (267 . 6/19 . 08) =14 . 0 . 
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.Table 2. Analysis of Variance Testing Effects of Page 
Environment and By-line on Overall Assessment 
Factual/Opinionated Nature of Article. 



Source of Variation 

Page Environment 
By-line 

Page Environment x By-line 

Page Environment, x 
Subject within form 

By-line x 

Subject within form 

Page Environment x By-line x 
Subject within form 

Constant 

Form of Newspaper 
Subject within form 



DF Mean Square 

1 36.30* 

1 .36 

1 .00 

53 6.56 

53 4.64 

53 6.22 

1 7423.70 

3 9.73 

53 10.83 



Table 3. F-Statistics for Effects on Evaluations of Defamed Person. 

Covariate F Indep. Effect F Interaction F 

Covariate Indep . Effect 



# of Phrases Environment 16** 2.1 1.1 

(1,53) (1,53) (1,47) 

# of Phrases By-line 17** 1.1 1.2 

(1,53) (1,53) (1,47) 

Overall Eval. Environment 4.1* 3.8 1.7 

(1,53) (1,53) (1,47) 

Overall Eval. By-line 3.8 1.3 .04 

(1,53) (1,53) (1,47) 



